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ABSTr ACT 

The hypothesis t hat participation in a Palasa 
Settlement House after-school , acadeaic-athl^tic prcgraa le^ds to an 
increase in acadeaic perfcraance in the targeted subject (Bath) in 
scho,ol IS exaain^d in this docoisejitv It is also of interest ±0 know 
whether or not the prograa is reaching its target group of low - 
acadecic achiever^. A saaple of youngsters who completed at least one 
^acadecic at hletic * season in the pro^rae is Eatched for sex, grad<^ in 
school, and school attended wiih a nonparticipating control group. 
For both- groups, school grades in oath, verbal and sath'scores on 
st^ndarjdized tests C^TZ? and SCAT) , and attendance in schocl are 
conpared for the year prior to and following the prograa. These, 
scores are ontained frois s'chool records. There is no difference^ 
between the two grobps on preprogram' school math grades and verbal or. 
aath a'chieveaent tests. The post program scores show that academic 
gains sade in the prograsa result in improved post prograa STEP and 
SCAT math scores but do not show up in postprogram school Bath 
grades. The findin^^s underscore both a success in the Palaaa Program 
for iiaproving aath ability and a failure for this to be reflected ixi ^-j^ 
school math grades. This iapiiresi^-ha need for closer cooperatfon : 
bitreHu youngsters school teachers ai^d^ the Palama acadeaic coaches .to 
ensure the generalization of prograa results to schocl perforaance. 
(Author/AK) 
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PREFACE 

In Decesber^^ 1973, che Soci-el Weifare DevelapHrent and Research Center 
issued a report entitled New Apprpacpes and Innovations at Palama Settlenent . 
It sunnarized v^o important prograzis at Palazia SettleiDenc, the In-Coanunity 
Treatment Projecc and the Behavior Modification Sports prograa. At that tine, 
Palana Settlement 'was cliaracterized as bein^ "one- of a fe*' programs in this 
. State thart have adopted a research strategy to continually assess*ef fee tlveness 
through objective data.' Tnis report' testifi-es to the accuracy of that state- 
ment. The data presented are part of chis continuing research strategy to 
assess the effect of tne acade-Tlc-at'^letic prcgrar. on future school performance. 

results have important implications, not only for the program at Palama 
Settlement, but for many similar prog.rans in this State as well as on the 
Mainland. ^ ^ 

For this accomplishment we once again recognize the facilitative role 
played by the Board of X^^^stees and the Executive Director, Robert H. Higashino. 
The prime mover of this research effort is Barbara O'Donnell who engaged in 
this study in preparing a Research Paper for her M. S. W. at the School o^ 
Social Work, University cTfS^awaii. This report has been adapted from her 
Research Paper with \inor revisions. Many people helped nake her study possi- 
hie. Of prime importance are Earlene Chambers and Keftneth Ling of Palama 
Settlement who continue to be bo'th committed to this project receptive to 
innovations; Joel ^ischer. Professor in the School oT Social Work, University 
of Hawaii, who served as a most able research advisor; and Clifford R, 0-Donnell 
of the Social Welfare Development and Research Center Who provided technical 
assistance fn research design and analysis, and c^on^ltation. 

Jack T. Nagoshi, Director 
Social Welfare Development 
and Research Center 



. ASSTSACI^ . . - 

Tnis sc^d\ exatir^ts trt hyDot^esis tfeat par :icipta t ion In a Palana Settle- 

menc iouse af ter- schc^ol , acacenc-arhiecic prcgrar leads to an Increase m . 

acadecic performance m tie targeted subject fnach) m school. ' It was iiso 

of interest to kno- whether or not the progr^ waS- rSeching its targec group 

of low-acade=irc achievers. A sample of youngsters who completed at least one 

acadenic-athle tic season ^basketball or footbell) the S^ctlenkent prograD 

• ' i * 

were matched for sex, gr^de ir sc-^ool and scn::oi attended with a non-partici- 
pating ccr.trcl group, Fcr bctr |roups., schcol graces in niach, verbal ^nd ' 
oath scores cn stardarcvzec tests (STEP and SCAT) and attendance m school 
were co'-pared both for the year prior to and following the progtac. 'Jn^se 
scores were obtained fron scqooL records* < ' * 

There wei'e no differences between the tvo groups ^zv pre-progran school 
raath grades and verbal or math achievement tests ^ Thus the pre-prograra scores' 
show that -volunteers were the same acadeaioally as non-volun.ceers , The post* 
program scores s*how that adademic gains made in the program result in icaproyed" 
post-program STEP and SCAT math scores, but do not show up in post-prograra 
school math grades: . * y 

Thes-e findings underscore both a success in the Pala^ia program for iro- 
{>roving math ability ^d a failure for this to be reflected in school , math . 
grades. This implies the need for closer cx)operaTloTi between your\gsters* 
school teachers and the Palama academic coaches (programmers of academic 
ma,teriaiy to ensure the generalization of program results to school per%farmance 
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The probler^s zi tjodt school perforrxance and nc?n-ac tendarrce , aropping out 
of schocl, schoDl vand^lisr and di\3g abuse are -^ell knc^vrn to educators, lav 
enforcers and :r.:>se m f.e nelping professiDns. polk and Scnafer propose 
•*tnac ediicational failure - by schools ^s well as by students - is directly 
relaced to delinquecicy ^ochios stated mat, "failure to naster the tools 
?f leai-ning • p^ticularly reading sVills -* leads 'children to en^loy copidg 
C;«tn^ds .r^f bravado-, 'sctir.g :ju:', and trja;:cy :o escape edbarr as snten t, ' anxiety 
and fa. lure . ' 

'PalaM Setilerenc --cuse in Hawaii hcs an after-school progras to improve 
• academe perforniance in a 5cnolastically low- achieving target papulation. 
Their basic concept is rooted in the behavior modification ^ppraach of rein- 
forcing, the prosocial behaviors of studying and team cooperation^ The program 
has. been shovm to improve students' math' ability from .5 to 1.2 School grades 
in 10 weeks. Tnis study is being undertaken to determine if this i©prove;aent 
'results <n higher school performance in math grades, achievement tests and ^ - ^ 
attendance. . ; • . ^ , 

/ . • <J ' . 

Relevance of School to DeHnquency ' , ' 

"OVei^ ohe m'iXlion young people are referred to the, juvenile courts each 
^ear, the nutnber representing close tjo 3% of all children between the ^ai« 
Of 10 and 17 (the population at ris}c)/'^ "At the same time, available evideftce 
fit1r\3ngly suggeists that delinquent, "^commttments result in part from adverse .or 

• c / 

, nfegatiye school experiences. ''-^ /The influences of poverty, broken and troubled . 
' - / f ♦ 

families and slum conditions^4Ve not dented. Elimination of juvenile delinqu^jncy 
waits upon raajar social cF^^nge,; howev;6r, as studies have shown a connection 



ber*^een juvenile delinquency and the school, there "ust be change as an iaevi- 
table part of prevention. ' *^ 

For low-pcrf crz-ar..we siudents, school is associated vith puaishrtent because 
of failed ccurses, negat ii/is-: of tc-^^ criers and parents, and a r.egativf self-iaage 
Association by school failure^ wich others who .nav^ failed Vnd a coocitciient to 
a delinquent conixuni'iy are possible avenues for tie drop-out. -'Tne essential 
T)otior. of tne vier^ is :hat. 3s a recult of i^.e lo-^ering of ar. individual's 
co^ini t3cnt» ic success and confomry, there is ah increased probability cf his 
tcrning iz a c^srac rer . s tic5 1 ly rebellious occr culture or significant social 
atcacnrents xnich, in : -rr , . I'-x reasc t^^ c.^r.ces :f irvolve-r^er c in oelmquency 
Suci a notion is supported by E~;>«> md LuoecK' ^whz found a hign correlation 
betweep dropping out of sc^.ool and delinquency, 

' \ ^ . ■ ' • 

Review of Literature^ • - 

Th-e pa^t 13 years have se&n an enorcnous anount of 1 i teratjure^ publ ished. 
on thre subject of behavior nodif icat ion . Material cm operant conditioning, 
in particular token ecjonomies whic'i rely on the principle cf itamediate rein- 
forcement for desired beha-rior, ^. forms the basis for a prQgram such as palam^'s 
Behavior Modification Sports Program, wherein athletics are us:ed as the rein^ 
forcer XP^in,crease academic behaviors- Studies on various types of programs, 

9 

including programs for youth in a course tional facility (Cohen and Filipczak, 

O'Donnell and DeL^ion,^^ and -JIcKee ^^nd Clemenw*?-^^) and for drop-outs from school 

(6*Donne^l and S tanley^^) , have suggested there may be copsiderab^e merit in 
r 

titlttzlng such* an approach. * 

One study^ which closely parallels the Settlement- program under investiga'- 
tion here was don6 by Wolf. Giles and Hall* This program had a sample of 
16 low- achieving students from a low- income neighborhood in Kansas City, All 



of then: scored at least Cwd years below the non?. for Chei*r grade "level f5th 
^d 6ch grades) on t-.e Scanford Achiever-ent Test rSAT). The parents were con- 
tacted by a social vcrker who explained the prograrn to thern; all parents 
contacted enrolled t-.eir children. The'Studepts attended ."schooT' in a nearby 
church basement eacn weekday after regular school for two and a half hour-s, and 
on Saturday aornmg during the acade::ric year. Ine program v>as t'n progress for 
15 i^nths. Pomes -^ere given for academic work completed either from the regu- 
lar sc^.ool zr tp.e remedial sc!-od1; for exanple, a student received 100 points 

-.nc 75 pcin:s frr a 5, ecc. Re inf orcers , vhich cculd be obtained with 
d :)?ir.:s, ir.cl-ced field crips, snacks, novelties and clothes, 
r concinser.cics -v*er€ provided tor in tre prograrr., such as bonuses for 
mscructors of children wnose scnoo\ grades -improved , bonuses for good student 
'behavior atid attendance, parties for report card improvement, and an opportunity 
for their regular school .teachers to add points for ' excellence in regular 
school or 'to subtract points for inappropriate behavior. 

The prLTtax>' goal vas to help' students make larger than usual gains in 
their academi<;^ skills^ The remedial group was randomly selected from the same 
pool of "low-achie^rs as a no''-"rreatnient control group. Students were ranked 
according to read ing. scores as measured by the SAT. The lowest scoring student 
was assigned to the remedial group, the next lowest to the control group, and 
so. on. Sixteen students were assigned to each group. Fifteen were in each 
^roup at the end df the program. SAT Scores and report cardgrades were recorded 
for^the two years preceding the prograrr. and for the year following^ the program. 
The met^ian gain 'after the 15 month program on report cards for the remedial 
group was 1.^, grade points, from slightly be^ow a D to a C average, while the 
control group gairfed 0.2 grade points. The median gain of the remedial group 
on the SAT was 1.5 years as'^ comparec? to 0.8 years for the controls. The pre- 
vious median gain on tho. SAT for both groups was 0.6 years. 

! 




The cose per student vas ab6ut $550 a y'ear-.^ The authors suggested tKcU 
costs could be. reduced by using reinforce-rs vhich already exist in the educa- 
tional setting. One of the suggested reinforcers was athletics, which the 
Palama program uses as a consequence for increasing academic behavior. 

Description of Palar.a Settlement 

Palama Settlement House, one of Hawaii ' s -oldes t -social work agencies, was 
fnnnHf^d in 1896. Since that vear, it has pioneered many social programs suc^ 

I 

young and many more. Historically, Palama Settlement efforts have gone lnto^^^-|||, 
aiding the disadvantaged. One of these urograms is the Behavior Modif icatioi^^X,^ 
Sports Program. It was reasoned that a sports program could provide an oufcl^l^^ 

'< 
''^^ 

foj: aggression and at the same time teach lessons about sportsmanship and com- 
petitiveness . The sports program is also used for the additional purpose of ^ 
providing moti,vation to improve academic skills. Bc^s participate as athletes 
and girls participate as cheerleaders. This participation is contingent upon ,r 
studying and improving academic performance. Points are* earned' by studying ^ 
in an individually planned program and for sports participation. Students, \ 
between lQrJs6^3ifears of age, from a Model Cities area who volunteer for the 
program must sign a contract ,specifying behavior^to be performed, such as: 

1. Do their best on all academic testing. \ 

? • ) ^ ' , 

2. Accept the acadenvic program designed by their ^academic coach* (the 
learning engineer at the; Learning Center). ^ 

3. Complete their academic program with at^least 90% accuracy each week 
to be permitted to^ practice with the athletic team. * 

4. Participate in dai^y athletic practice. 

5. Eat at the Settlement daily during the athletic season according to 
dietary prescriptions. 
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6. Follow all recommendations based' on medical and dental exan\lnations . 

Once the contract is signed and the student enters the Sports program, 
academic skills are assessed And an individualized program is prepared; ^resting ^ , 
is done at the Center and must\ reflect 90% accuracy. Points are earned for 
hours of academic work and for performance on th^ athletic fie.ld. These points 
arid gold stars are publicly posted and can be exchanged for sports equipment 
*and sportswear. Volunteej- academic coaches also receive star^ redeemable for 
clothes and dinners, etc. ^ A sample daily schedule for the studen^ts might 
as follows: practice 4:30-6:00 p.m.; shpwer 6:00-^:'30 p.m., dinner 6:30-7:00 p.m.; 
, study hall 7:30-8:30 p.m. The use of Palama facilit,ies for study hall is op- 
tional, but points are awarded for .using it. Sports competitions are held on 
weekends. ' , » i , 

A previous study on. the program under investigation here by O'Donnell, 
Chambers and Ling^^ found that reliable gains of .5 to 1.2 grade levels on 
the Stanford and California Achievement Tests were achieved during the lO-week . 
athletic season between pre- and .i>ost-^tes ting in all areas in which academic 
work was programmed. These results suggested that youth whose' mean pre-score^s 
are below average on national norms can achieve sizable gains in math in 10 
weeks. . 

Research Question and Hypothesis , 

I- . . 

The present study was designed to answer two questions not addressed in 
the above mentioned study. First, were those who vol&nteered for 'the program 
higher, equivalent or lower in school performance as compared to students from 
the^^ame area. and schools ,who did not volunteer for the program? In other 
words, is Palama reaching its low-achieving target group? If the students 
who volunteered for the program were performing higher in school to begin with, 
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this could -be the reason for the program's success. It would also meap the 
target group was missed. .If. the academic levels were equivaler^t, results could 
be generalized to similar students fn Kalihi-Palama schools, but the target group 
would again be missed. If the program volunteers were of lower* academip back- 
grounds, then the target group would be reached. 

The second question seeks* to answer whether or not the program results 
generalize to post-program schox^l performance. The hypothesis Is that {^alama 
progr^nr'ef forts do result in higher academic performance in the targeted subject 
in regular school. , • . 



ffilHCDOLOGY 



aapje Selection 

' Youth who voluntarily participated in the athletic-'acadeniic prcgrar at 
Pjlama Set t lenent **durlng cne Fall, 1971, corprised tr^ experimental group. 
Hon-particxpan ts , who were rartdo^ly ^electee, -^ade up the control group. The 
random procedure to select non-parricipants .>'as the sane at each Kal lhi-?alacaa 
school that was attended by a Pala-a voliJr.ceer. This procedure^ cons isted of 
patching rando'-: numbers fror. a randc-. nur.ber cable .;ich" a List of students in 
rfie sane grade as z^.c volunteer. If che randcr. nu.T^ber -r:atchec a girl wi^^^* a, 
male volunteer, that nu'-iber was discarded and the next one was tried until 
each Palama volunteer was matched with a random selection of students frora the 
same school, in the sane grade (grades 6-10), and of the same sex. 

v 

Measures of Qutoome > • 

In order to determine if Palama was reaching its low- achieving target 
group, pre-prograin entrance data were collected from the school records for-^ 
both, the. experimental and control group students. These data were: school 
attendance records, school math grades, and mat*h and verbal, percentile scores 
on the Sequential Tests of EducatiDnal Progress (STEP) and the School and ^ 
College Ability Test (SCAT). 

School math grades and STEP and .SCAT raath, scores are measures used since 
the Palama program in the Fall, 1971, foctjsed oaly -on math .skills. Every 
other year, the program focuses on math skills; in alternate 'y^^rs , the focus 
is on Verbal skills. - 

Since the focus in the Fall of 1971 was on math, verbal achievement test 
scores were collected to serve as a comparison coritrpl for any differences .in 
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dach scores betwecr the cy,.pcririencal and ccntrcl groups. It was reasoned "ffiat 
if the ?ala:^a ptograo had any effect on achievement scores, it should occur 
only in the oath secxion and not in the verbal sections of the SG^T and STEP, 
laprovenent in both the rath and verbal sections would negate assuming that 
laprovenent m r.ath was cue to Palania's intervention. 

Description of Data Collection 

All data were cotained fror school records at the schools involved. The 
pre-prr^gra-- data were collected for the Fall% 1970, and the Spring, 1971, since 
the prcgrar:^ be ing examined was in progress m the Fall of 1971. The pre-progran 
data were collected in order lo corjpare the academic level of volunteers with 
non-volunteers. - . ^ ' 

These same data, school . at tendance , schoof math grades, and STEP and SCAT 
math and^verbal scores, were collected for the two semesters following the 
program (Spring and Fall of 1972) to determine if the already knovm Palama im- 
provement generalized to post-program school perf ortaance 

Attendance records were avai]table for 34 Palama students who were enrolled 
in "school both before and after their participation in Palama. Math grades 
were available for 28 of those 34 students as not all 34 were enrolled in pre- 
and post- Palama math classes. The number of students who had taken both pre- 
and post-program STEP and SCAT tests numbered 12. Since complete data were 
therefore not available for all students, numbers of students iTange from 12 on 
achievement test comparisons to 34 students for attendance comparisons. 

Statistics Used 

The t-test was used to measure differences between the control and experi- 
mental group pre-Palama (Table 1) and to measure the differences between the two 
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groups on school performance after Palana (Table 3). 

The Pearsoa produce soiaenc correlacicn coefficient was used to decernine 
if there was a relacicnship between tie per f crrsance of students in 'the Palarra 
program and their post-Palaca perforraance m regular school. Tnis vas mtendexS 
to determine whetner the nath gains siade in Palania correlated -wi th post-progran 
school performance. 
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This studw IS designed tr =-.s^er r-'c c«-es tic:nr*. ."i^ firs: is wnether :ne 
Palaz^ pr^grar Is r€ac-ir.£ ;t=^ lc---^c- icvxr.z target trvso and cne second is 

v 

vrhecher inv<;lveTent m che ?alar.a prograr --ill :rprov€ pcst-prcgrais scnccl per- 
forsiance. For clar:.c> .tr.ese questions are dealt wiin separacely; tre 
forsier cuescion is discussed firs: and z^.e latter c^>estlor* icIIdws. 



Lc^--Ac?^ieving Students Is ?alar-^ reac- mg i :s' Tar^e : rcu? 
> 

Tne Palaria ^cC"tle-en: ac zde-nic - letic prozr^- :s essentially ai-ed at 
lov- achieving stx^dents -eca^-^se they ari l-.Vel>/ candidates to arc/ oct cc school. 
As discussed earlier , tne 'crop-c^t ij a pcte^cial del inquent , . a^d ch:s potential 
drop-out group of low-a'Ch levers is Jala-a s/jftlenent's target ,4^-^^? • carder ^ 
to determine if this group of lov?- fcnieverl/ was yolun tecrit?g/f or the program, 
pre-prograca entrance data on scnoo^ absen/|(s, s<;nool aatn ^ades, and STEP 
and SCAT test scores were collected for tae tvo seze^ters fcrior to the prograo. 
The purpose of this study, in p^rt then, /is to detBrmme ^f youth who volunteered 
for the prograoj differed from non- volurfteers , and. if so Jon which neasures. 



The experimental group woiUd have tp be signific^n 

sLsures li 



control group on at least sone of the lebsures. listed ip iTable 1 for Palama 
to be considered as successful in attrac)ting the low- achieving target group. 
Pre-program differences between Palama volunteers and the control group of non- ^ 



ly lower than the 



in Table \ 



volunteers are presented in Table 1.- , 

'Since no predictions were tnade, the cata in Table ^ were analyzed by two 
tailed t- tests. This analysis revealed tHat the exper iriental and control 
groups differed sigrflf icantly only in scho(il attendance. This shows that the 
Patama project was r^ot reac'hing it£ low- achieving target group. 
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Means ot ?re^?r^$ra:^ School Perfofsiance for the 1970-71 School Year 



Measures 


Expert- 


encal 




Control 












X 


S.D. 




T 
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f 


Lev , 


of Sig 
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■7.1 


6.8 • 
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.01 ' 
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45 
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36 


29 
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SCAT Quant 




32 
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STEP Readin£ 
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26 


12 
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SCAT Verbal^ 




27 




36 
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12 
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A - 


9C, 




7C,- D = 6 










or •■- 


' c Our. ting 
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Generalization cf Palara Results 

The second question in this study is -^^hetner the aath gains mad^ as a 

result of the prograc generalize to post-prograni school perfornance . Tnis is 

assessed by two different methods, first by coopering the means of the post- 

prograa STEP and SCAT (Table 2) for both the experimental and control group, 

and second by correlating', for. the experimental group only, program math gains. 

♦ »» " 

and post-program school performance- (Table 3) . ' ' 

Table 2 presents data to assess whether the size of the program njath gains 

was suffici-ent to raise the SCAT and STEP. math percentile scores of -the expexi-- 

mental group in z^elatlon to the control group, ^ 



Means of Post-Program School Performance an STEP and SCAT XA^Xh Tests 



Measures 


Experimental 


Control 




t 


t 




X 


S.D. 


X 


S-D.' 


K 


t 


Lev. of Sig 


STEP Math 


A2 


'iU 


39 


•22- 


12 


< .2a 




-SCAT .Quant . 




3^ 


32; 


30 


♦•'12 







These data were analyzed using one- tailed t-t^ests. None of the differences 
were statistically significant between the experi'Sental and control groups. It- 



\ , ' .12 
is apparemt that the .-^v^age gams -ade by students in the e>q)eriDental group 

• ^ere not lerge enougn to ni^ke their percentile SCAT and STEP ta^th scores slgni'- 
ficantly greater as a vhole than these students in the control group. 

The second way ic assess tne inpact of the Palaraa program (Table 3) is to 
correlate the program natr. gains vith pes t-progran: school attendance, achievfe- 
aent tests (STEP and SCAT taken at regular school) and school math grades. 
It was assuHied t'^at the results pi tne prograr. would generalize to future 
school perfoxnance. For this aseurrrpiicn to be supported, progran: oatJbLrgains 
arnd posc-progra- oerrorrance or. tre "^ir. sections of the SCAT and STEP, school 
r.ach griades, yr scr.ool atCer.dar.ee would '".a\Se zz correlate at a significant level 
Smce tne Palana program focused only on r,otn skills, it was. not* expected that 
SCAT'and STEP verbal scores woirld /lave a , s ignif i<:ant correlation (a control to 

►show that any relationship to test perforoance is specific to the subject 
studied in the Palaria program). Data appropriate for this analysis are school 
absences, school rr.ath shades, and ST^P and SCAJ test scores for all of the 
experimental group youth f or- Jthe twtj semesters following th^ Palama prog^-am. 

T-o^ be certain thSt .cbrrelati5K>s made on the basis of these post-ptogram 
measures would not, be affected b/ differences in pre-program scores all measures 

4 

were statistically adjusted for any 'pre-scpre numerical differences-. In this 
way, any remaining differences In the j)os t-- scores cannot be a'tttibuted to ini- 
tial, i.e., pre-score, differences. Thus the correlation here is actually 
measuring th^ relationship between Improveaent in the Palama program and improve- 
ment on the school SCAT and ^TZP t^sts. ' ^ . * , 

Pearstjn prod^jct moment* cofrelations be tw^i^ -ad justed math gains raade in 
the Palama program and Adjusted po;>tA program school performance measures are 
shown in Table 3.' , - ' . ^ % 
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T-able 3 



Correlations between Prograni Math Gams and Post-Program 
School Performance Measures for the L'^periaental Group 

Measure , . Correlations 









Lev . of 




Lev. of 








Ccmputations^ 


Sie. 


X^oncepcs^ 


Sig. 


K 


Da>^s 


"absent, Spring 


.29 


. KS 


.lU 




34 


Days 


absent^ Fall 


^ ' .02 


N'S 


. - .05 




34 


Math 


grade, Spring 


-.11 * 


KS ' 


.03 




28 


Mafh 


grade. Fall 


- .01 


NS 


. .07 


.vs 


28 


STEP 


Math , 


. 5t 


.35 


.73 




12 


SCAT 


Quantitative 




. 05 


.39 


' .10 


12 


STEP 


Ffeadiag 


-.32 


N'S 


.10/ • 


NS 


12 


SCAT 


Verbal 




NS ' 


-.28 


•■N'S 


12 



^Con:p'u tacions and Concepts '.v'jere the. riach- ar^as progracnied and 
measured during tne Palaca orcgrar:i. 



As shown in Table 3, Palaraa program math gains generalize to future aca- 
demic performance as measured by STEP and SCAT math tests taken at school. 
One caji, - therefore, predict frons impr^jvement in Palac^a that there will tend to 
be an irmprov^ent on tests in school '(STEP and SCAT). As expected, post-Palama 
SCAT and STEP verbal and reading scor^^s did not correlate with math gains naade 
in Palama\ Therefore, it is apparent that generalization to post-Palama 
achievement test performance is specific to the subject studied in the Palama 
progr^. Program math gains, however, did not- generalize to either school 
math grades or school attendance. ' ^ 



«)KCUSIOKS AND'IMPLICATIOKS OF STl'DY 

/ 

Major 'Conclusions 

One of the questions in tnls study is' vh'rther or not the Palatja progran 
results generalize to school perf crTiance^in the targeted subject, nath. Results 
in Table 3 reveal thac there is a correlaclon becween nanh gains made in the 
prograr. and perforrrance on ^-^.e'-ach sections of. the STEP and SCAT post-program 
achievenent cesLs ta'^cn in sc^.ool. The sigr.if ican,:- correlacions shov: that Che * 
higher the rach score ir. Pala-^, the higher :he S.i.? and SCAT T.ath perfornance 
in Table 3. "The correlanors ocoirrec ^nl% Ln* c^e natn and not in the reading 
tests x>f the STEP and SCrT, an mdicaiion :r<it ir^provecent vas likely a function 
of tne Pala^a r.ath program and not arcriDutable to other factors. Further, 
since all scores were adjusted for their pr^-program levels, this result is not 
likely a factor that could be attributed to prior differences (e.g., "smart" 
students do better at Pala-na and at school). 

The lack of difference between the means of tHe experimental and control ^ 
groups (Tabl-e 2) on the post-prograa STEP and SCAT math sections indicates that 
the average gain made -i)^ the program is not sufficient to raise a participant's 
math performance relative to" other students*. In other wprds, the control 
group and experimental group means are^not different (Table 2). Since the ^ 
corVelatiw results show that the STEP and SCAT are sensitive to the math 
gains made in the program, it is reasonable to assume that longer programs which 
resulted in larger gains might increase a participant's math performance rela^ 
tive to non-participating students. 

These results indicate the ^importance , for programs designed to improve 
school performance, of assessing the relationship between performance in the 
special program and performance in school. The assumption that program resu^lte 
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shewing an isaproveacYit i-n ^cadeaic perforoance will autoaaticelly be reflected 
in scbool per fi^i^cianc^ is rioc tenable. 

A second question this study sought to answer was whether or not the ^ 
Pal^na Settlement/ Behavior Mcdificaticm Sports -Progran was reaching its low- . 
acadesic achievement carget group! Tne dac^t froa Table 1 reveal that essentially 
there is no difference beTween the exper iciental and xontrol group wtiep they ^ 
enter the p.rogras, except that: the experinentaf -group is absent 6.3 more days 
a yearr. Since the' control and experiiiental groups are very such alike, acadenic 
gains achieved m the program: cannoc be accributed to brighter students parti- 
cipating in the Palanva pz-ograr than are enrolled in the regular school. % 
Therefore, the Palana progran is reaching students similar to a random sampling 
of students from the sane schools, but not the targeted low- achieving group. ^ 
The students in the Palama program are neither higher nor lower in academic 
achievement than the control group. 

If it is desirable for the program to reach low-achieving youth, it may 
be possible to scji^een out the volunteers with higher grades and achievemeijt 
test scores.. By eliminating the relatively higher acadecxic achievers, it may 
be possible to enroll more low- achievers . One advantage of having Palama youth 
similar to students enrolled in regular school is the ease with which these 
resiiKs would then generalize to similar public school students should the 
Department of Education wish to^ incorporate a program such as this in the public 
schools. , . ' . • 

In conclusion, the two major findings are that the program results (i.e., 
Improvement in math) are discernible on the postrprogram STEP and SCAT math 
sections, but do'not show up in post-program school math grades. Secondly, the 
Palama program is reaching neither a high nor low achieving student, but one 
yhich is* the SBme ^s a random sampling of students (control group) In the same 
grades* and from the schools attended by the Palama program youth. 
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Relation to Other ^t-^dies 

It IS perhaps s .rpri s ir.g a: ca-r.i.-ade :r i-e Palana prograr ccrreU:€ 
with iziproverienc m -v2:r ability !r.t rave ro ef:ei;,t oir. -3^h perf orr^apce , i.e., 
school nat± grad^^s . Hc-.'cver, similar reS'-lcs -ave^:;ee^ reportec b> Ttr^rp and 
Wetzel^^ and To and : 'Dc-r.ei: This r.ay occjr because of.grades being z^ore 
a function cf the :e«c-.er's expec:aci?r£ r^an of tee pupiVs acca>^l ability 
(Rosentnal and Jacorsen).-^ In -.oser.rnal af.c ;accb5e;:*s srudy^ teachers* 
expectarxies vere >.gr ■ f liar.: ter-irar :s :: 3:.cer: re^porses. In eac^i cf 
the 15 classes, a-.er.^c- :: 2: r: - .Icrer. -.re :r :-c experirencal 

condition. Teachers ••ere :-.d r^^: — cs. sc^ecr.ts -.--.Ic s-.ov unusual intellec- 
tual gain-s during cr-e sc^odT vear. ' The scude^ts were actually selected by a 
random procedure. These chi Idrer^ showed a signif ie?mtly greater gain in IQ 
scores than did the control children.- Tie lover the grade level, tne gre^ater 
the effect- ■ ' -n ^ 

The factor of teacher expectancy may be a possible explanation for the 
lack of car^-over of Palana gains to the public schools. It ciay.be that for 
students who have not done v^ell in the past, encouragement for work well doxie 
may be lacl^ing. Students may pick up cues that the teac^her doesn't think they 
will do. really good work. In large classes especially, since these teachers 
may not be aware they give these cues, attention pay be given to those students 
who have proven themselves to be high achievers ^with a corresponding lack of 
attention to the Ipw achievers ^ If students have demonstrated thaf they can do 
well when pos itively rreinf orced by something that is of value to the|^ (athle- 
tics), the ability to do tlie v;ork has proven itself to be there. 

The Wolf, Gil^s and Hall^^ s tudy^ mentioned earlier-inc lud^ the regular^ 
school teachers in their program by having s.tudents bring in homework from . 
regular ^chbol to do and gain points*'. They .also billow these same ^ teachers to 
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add pomes for appropriate acadenic behaviors. In this vay, the regular school 
teacher is a oart of the program and can see the gains made by the student in 
the special program. The Palana program night do well to consider involving 
the regular school teachers, If this is possible. 

Stud^YTCS could earn poin/s at Palana for ccapletlng school homework assignr 
ments and for perforaance on school tests. Teachers would then becoce aware 
the progra:^ and see it as ar. aid both to checiselves and to the students. This 
•night bridge th^ gap between c^e Palana perforrance and the school performance. 
It eight also affect tre pr€sur:e<i "attitude factor' by giving teachers a 
chance to see low-acniever's achieving ac Palara. A sir.ilar rrethod could be 
used to affect 'school attendance. Points could be given at Palana for school 
attendance as indicated by school records. This aight be done especially for 
students with a high absenteeiscn rate. 

Iiaplications , 

Previously, Polk and Schafer were quoted as saying, ''that educational 
'failure ^ by schools as well a$ by student? - is directly related to delin- 
quency/*^^ Palaoa Settlemenj: deals direc-tly with youth from a low- income 
urban area who are possible future candidates fbr delinquency. The purpose 
of the , program -is tworfold; first, it-^is simply to iBiprove math performance 
fdr its own sake> and second, an' improvement ir^math skills^ as a result of the 
prosratn 1$ assumed to cArry over into- regular school math performance": There, 
success in coping. with .math w6uld hopefully Wake school less aversive by in- 
creasing successes and thus reducing chances' for dropping out. ♦ 

They prjovide relnfjor cement (athletics) for prQsocLal beha^Vior (studying., 
;teato cooperation, renouncing of criminal activities) and block rewards for 
antisocial behavior (crime/ ii^noning studies, rfoncooperation) * The program has 
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shown itself to be worthy by denonstrating, through Che use of a tdken economy 
system with athletics as ttje reinforcer, that low- academic achieving students' 
can be raised 0.3 to 1.2 gratle levels in iO weeks as measured on the California 
and Stanford Achieveaent Tests, The present study has shown that although 
students rfake these gams, the improvement 'does not show up in post-program 
school grades. 

The inplications for further innovation and study ar^ cleai*. Perhaps 
students could be partially reinforced bet.:een seasons in order to maincaio some 
of the academic behaviors^ gained . Points could be earned between seasoni^for 
grades or attendance *-C_be applied :o r^e regular athlecic-acadenic seasons. 
Also, these scasorJ^* mii^ht be extended, or a tnird sports season might be added. 

The need for carry-over is important if students are to succeed and remain 
in school, hopefully less prone to delinquent problems. If, as studies have 
shown, the drop-out is .more prone to delinquency, every effort must be made to 
assure hi6 remaining and finding success at school. 

In conclusion, two points are stressed: 1) academic success in a special 
program does not* automatical ly result in academic improvement in school, and 
2) if the results of such programs do not generalize to school performance, ^ 
then they clearly cannot be expected to prevent delinquency (since their ration- 
ale is that such prevention occurs by Improving school performance)^. 

Two general changes need to be made as a result ^of this study. First, 
efforts to obtain generalization to school performance should be an integral 
part of every special academic program and secondly, data on future delinquency 
are needed to evaluate the assumed effects of such programs. These results 
indicate that such untested assumptions may be unwarranted. These implications 
not only apply ta ''the program at Palama Settlement but also to the many other^ 
academic programs in Hawaii and the Mainland. * ^ 
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